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1.  Summary  of  Technical  Results 


Six  technical  reports  were  written  in  the  period  June  1,  1986-June  29,  1987 
which  made  extensive  use  of  the  equipment  provided  by  Grant  AFOSR-86-0255.  The 
titles  [l]-[6]  of  these  repons  are  listed  in  Section  2.  The  principal  area  of  our  research 
has  been  the  solution  of  very  large  sparse  linear  programs  and  linear  complementarity 
problems  by  successive  overrelaxation  (SOR)  methods.  Another  important  ingredient 
of  our  research  has  been  the  parallelization  of  our  SOR  methods  as  well  as  other  clas¬ 
sical  methods  such  as  the  simplex  method  for  linear  programming  and  Lemke’s 
method  for  the  linear  complementarity  problem.  A  major  contribution  of  our  research 
has  been  the  solution  of  one  of  the  largestgeneral  linear  programs  ever  attempted  on  a 
workstation  (or  in  fact  on  a  mainframe),  'we  solved  [3]  va  linear  program  with  500,000 
variables,  125,000  constraints  and  1,125,000  nonzero  matrix  elements*  in  less  than  72 
hours  on  one  of  the  MicroVax  II  computers, provided  by  this  grant.  None  of  the  other 
state-of-the-art  simplex  packages  could  solve  considerably  smaller  linear  programs  on 
the  same  machine. Another  significant  achievement  of  our  research  has  been  the 
parallelization  of  our  SOR  methods  with  speedup  efficiencies  sometimes  exceeding 
100%.  The  MicroVax  II’s  were  used  to  test  simulations  of  the  parallel  SOR  algo¬ 
rithms  before  their  implementation  on  our  multicomputers  and  multiprocessors. 
Details  of  our  results  are  given  in  the  enclosed  six  technical  reports  [l]-[6].  We  give 
below  summaries  of  each  of  these  reports: 


[l]  A  parallel  successive  overrelaxation  (SOR)  method  is  proposed  for  the  so¬ 
lution  of  the  fundamental  symmetric  linear  complementarity  problem.  Convergence  is 
established  under  a  relaxation  factor  which  approaches  the  classical  value  of  2  for  a  loosely 
coupled  problem.  The  parallel  SOR  approach  is  then  applied  to  solve  the  symmetric  linear 
complementarity  problem  associated  with  the  least  norm  solution  of  a  linear  program. 


[2]  A  gradient  projection  successive  overrelaxation  (GP-SOR)  algorithm  is  pro¬ 
posed  for  the  solution  of  symmetric  linear  complementarity  problems  and  linear  programs 
A  key  distinguishing  feature  of  thi>  algorithm  is  that  when  appropriately  parallelized,  the 
relaxation  factor  interval  in  »t  reduced.  In  a  previously  proposed  parallel  SOR 

scheme,  the  substantially  rvduiecl  relaxation  interval  mandated  by  the  coupling  terms  of 
the  problem  often  lead  to«d<sw  onvorgence  The  proposed  parallel  algorithm  solves  a  gen 
eral  linear  program  by  fin-in. c  iK  least  -  norm  solution.  Efficiency  of  the  algorithm  is  in 
the  o0  to  100  percent  rang--  as  demonstrated  by  computational  results  on  the  CRYSTAL 
token-ring  multicomputer  and  the  Sequent  Balance  21000  multiprocessor. 


[3]  Serial  and  parallel  successive  overrelaxation  (SOR)  methods  are  proposed  for 
the  solution  of  the  augmented  Lagrangian  formulation  of  the  dual  of  a  linear  program.  With 
the  proposed  serial ‘version  of  the  method  we  have  solved  linear  programs  with  as  many  as 
125,000  constraints  and  500,000  variables  in  less  than  72  hours  on  a  MicroVax  II.  A  parallel 
implementation  of  the  method  was  carried  out  on  a  Sequent  Balance  21000  multiprocessor 
with  speedup  efficiency  of  over  65%  for  problem  sizes  of  up  to  10,000  constraints,  40,000 
variables  and  1,400,000  nonzero  matrix  elements. 

[  4  ]  We  present  a  parallel  asynchronous  successive  overrelaxation  algorithm 
for  the  solution  of  symmetric  linear  complementarity  problems  and  linear  programs. 
A  distinguishing  feature  of  this  algorithm  is  that  processors  need  not  communicate 
after  each  update  of  the  solution  vector  and  therefore  processor  idle  time  can  be 
avoided.  The  proposed  parallel  algorithm  is  applied  to  finding  least  2-norm  solu¬ 
tions  of  linear  programs.  Improvement  is  observed  over  the  synchronized  version  of 
the  algorithm,  the  parallel  gradient  projection  successive  overrelaxation  algorithm. 

[5]  We  propose  a  two-stage  successive  overrelaxation  (SOR)  algorithm 
for  solving  the  symmetric  linear  complementarity  problem.  After  the  first  SOR 
preprocessing  stage  this  algorithm  concentrates  on  updating  a  certain  prescribed 
subset  of  variables  which  is  determined  by  exploiting  the  complementarity  property. 
We  demonstrate  that  this  algorithm  successfully  solves  problems  with  as  many  as 
10,000  variables  which  cannot  be  tackled  by  other  current  algorithms. 

[6  ]  We  propose  a  parallel  implementation  of  the  classical  Lemke’s  algorithm 
for  solving  the  linear  complementarity  problem.  The  algorithm  is  designed  for 
a  loosely  coupled  network  <>f  computers  which  is  characterized  by  relatively  high 
communication  com-.  A<’  provide  an  accurate  prediction  of  speedup  based  on  a 
simple  operation  count,  f  i .*■  algorithm  produces  speedups  near  p,  where  p  is  the 
number  of  processor-,  when  u  on  large  problems  as  demonstrated  by  computa 
tional  results  on  the  CR\  b  TAL  token-ring  multicomputer  and  the  Sequent  Balance 
21000  multiprocessor. 
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